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Abstract 



, Searches for scalar top and scalar bottom quarks, as well as for mass-degenerate 

Q ■ scalar quarks of the first two families are performed at 189 GeV centre-of-mass 



energy with the L3 detector at LEP. No signals are observed. Model-independent 



D . limits on the scalar top production cross sections are determined for the decay modes 

ti — *• cXi and ti — > hiu. For scalar quarks of the other flavours q — >• qx? decays are 
considered. Within the framework of the Minimal Supersymmetric Standard Model 
/\ ■ mass limits are set at 95% CL. for these particles. Indirect limits on the gluino 

d • mass are also derived. 
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1 Introduction 

In the Minimal Supersymmetric extension of the Standard Model (MSSM) [Ij for each helicity 
state of Standard Model (SM) quarks, qL,R, there is a corresponding scalar SUSY partner qL,R. 
Generally, the left, qL, and right, q^, eigenstates mix to form mass eigenstates. The mixing 
is proportional to the corresponding SM quark mass and to the parameter a^ = A^ — fi cot /3 
for up type quarks and a^ = Aq — yUtan/3 for down type ones. Aq is the trilinear coupling 
among scalars, fi the Higgsino mass parameter and tan/5 the ratio of the vacuum expectation 
values of the two Higgs fields. For the first two generations of scalar quarks (squarks) the weak 
eigenstates are also mass eigenstates to a good approximation. However, this does not hold for 
the squarks of the third family. Due to the heavy top quark the tL — tR mixing is enhanced, 
leading to a large sphtting between the two mass eigenstates. This is usually expressed in terms 
of the mixing angle, ^lr- The lighter scalar top (stop) quark 

ti = tL cos 6'lr + tR sin 6'lr (1) 

can thus be well within the discovery range of LEP. Furthermore, if tan/3 > 10, large bL — bR 
mixing occurs. This may lead to a scalar bottom (sbottom) quark, bi, also light enough to be 
accessible at LEP. 

In the present analysis, R-parity conservation is assumed, which implies that SUSY particles 
(sparticles) are produced in pairs; heavier sparticles decay into lighter ones and the Lightest 
Supersymmetric Particle (LSP) is stable. In the MSSM the best LSP candidate is the weakly 
interacting lightest neutralino, Xi- 

Squark pair production at LEP proceeds via the exchange of Z/7 bosons in the s-channel. 
The production cross section is governed by two free parameters: the squark mass and the 
mixing angle, 6'lr |2j- At cos6'lr ~ 0.57 the stop decouples from the Z and the cross section is 
minimal. The corresponding value is cos^lr ~ 0.39 for the sbottom. The cross section reaches 
the maximum at cos6'lr=1 when the light squark mass eigenstate is the weak eigenstate. 

At LEP energies the most important stop decay channels are: ti -^ cx5; bz/^^, h£ui, and 
hxty where the i and ui are the supersymmetric partners of the charged leptons and neutrinos, 
and the x? and Xi are the lightest neutralino and chargino, respectively. The ti -^ bxf decay 
channel is the dominant one when kinematically allowed. However, the current limits on the 
chargino mass 3j preclude this decay to occur, except for a small region in the MSSM parameter 
space with the common scalar mass (mg) from 60 to 90 GeV. Similarly, the ti —>■ huii decay 
is precluded by the current limits |3] on charged scalar lepton masses. The stop analysis is 
performed considering the ti -^ ex? and ti -^ hiue decay channels, with Ui decaying invisibly 
i^i -^ ^eXi- Since the ti -^ ex? is a flavour changing weak decay, the ti -^ hiue channel 
is dominant when kinematically allowed. Therefore the two decay modes are investigated 
each with the assumption of 100% branching fraction. For the stop three-body decay channel 
ti — > hiui, two scenarios are considered: i being e, /x or r with equal probabilities or pure r. 
The latter occurs at high tan/? values. 

For sbottom, as well as for the first two generations of squarks, the q — > qx? decay mode is 
investigated under the assumption of 100% branching fraction. 

Since the stop two-body decay ti —>■ ex? is a second order weak decay, the lifetime of the ti is 
larger than the typical hadronisation time of 10~^^s. The ti —>■ hii) decay proceeds via a virtual 
chargino exchange and the lifetime is also expected to be larger than the hadronisation time. 
Thus the stop will first hadronise and then decay. For the sbottom the situation depends on the 
gaugino-higgsino content of the neutralino: for a gaugino-like neutralino the sbottom lifetime 



is expected to be larger than the hadronisation time. In the present analysis a 'hadronisation 
before decay' scenario is followed. Although hadronisation does not change the final event 
topology, it affects the track multiplicity, the jet properties and the event shape. 

The present study supersedes previous L3 limits on stop and sbottom quark productions [S]. 
Searches for supersymmetric quarks have been performed by other LEP 6J and by TEVA- 
TRON [3IH1 experiments. 

2 Data Samples and Simulation 

The data used in the present analysis were collected in 1998 at ^^=189 GeV using the L3 
detector [Oj. The total integrated luminosity is 176.4 pb~^. 

Monte Carlo (MC) samples of squark events are generated using a PYTHIA based event 
generator ^HI- The squark mass has been varied from 45 GeV up to the kinematical limit and 
the Xi mass from 1 GeV to M^^— 2 GeV or to Mj^ —5 GeV for the stop and sbottom two-body 
decay modes. The ti —>■ hiu and ti -^ hru channels are generated with z> mass from 43 GeV 
to Mi_^ — 7 GeV. In total 160 samples are generated, each with at least 2000 events. 

The following MC programs are used to estimate the Standard Model backgrounds: PYTHIA 
[H] for e+e" -^ qq, e+e" -^ ZZ and e+e" -^ Ze+e", KORALZ [E] for e+e" -^ t+t', KO- 
RALW [IB] for e+e" -^ W+W", EXCALIBUR [HI for e+e" -^ W^e^i/, PHOJET [15j for 
e"'"e~ — s> e"'"e~qq and DIAG36 JH] for e"'"e~ — > e"'"e~r+r^. The number of simulated events 
for each background process exceeds by 100 times the statistics of the collected data samples 
except for the two-photon collision processes, for which the MC statistics amounts to only twice 
the data. 

The response of the L3 detector is simulated using the GEANT 3.15 package [Ej. It takes 
into account effects of energy loss, multiple scattering and showering in the detector materials 
and in the beam pipe. Hadronic interactions are simulated with the GHEISHA program J18j . 

3 Event Preselection 

The signal events of ti -^ cx'J and bi -^ bx? contain two high multiplicity acoplanar jets 
originated from c or b-quarks. In addition, two charged leptons are present in the ti — > b£z> 
decay channel. The neutralinos and sneutrinos in the final state escape detection leading to 
missing energy in the event. A common preselection is applied to obtain a sample of unbalanced 
hadronic events. The events have to fulfil the following requirements: more than four tracks; at 
least 10 but not more than 40 calorimetric clusters; a visible energy, -Evis, between 5 GeV and 
150 GeV; an energy deposition in the forward calorimeters less than 10 GeV and a total energy 
in the 30° cone around the beam pipe less than 0.25x£'vis; a transverse missing momentum, 
pmiss^ greater than 2 GeV and a sinus of the polar angle of the missing momentum, sin6'miss, 
greater than 0.2. 

After the preselection 3110 events are retained, compared with 3514 ± 48 expected from 
the SM processes, which are dominated by two-photon interactions. Figure ^ shows the distri- 
butions of E^is] the absolute value of the total momentum of the two jets projected onto the 
direction perpendicular to the thrust axis computed in the transverse plane, -Ettj; the energy 
of the most energetic lepton. Eg and the b-tagging event discriminant, -Detag- -Detag is defined 
as the negative log-likelihood of the probability for the event to be consistent with light quark 
production J19j. After preselection the data and MC are in good agreement. The discrepancy in 



the total number of data and MC events is localised in the low E^is region, which is dominated 
by two-photon processes. This effect is taken into account by assigning a systematic error of 
10-20% on the two-photon cross section. 

4 Selection Optimisation 

The kinematics of the signal events strongly depend on the mass difference between squark 
and neutralino, AM=Mq — M^o. In the very low AM region, the visible energy and track 
multiplicity are low. Therefore, signal events are difficult to separate from the two-photon 
interactions. For high AM values, signal events will be similar to W"^W~, W^e^z/ or ZZ final 
states. The most favourable region for the signal and background separation is expected at 
AM=20-40 GeV. 

To cope with the various background sources, the searches are performed independently in 
different AM regions. For ti —* c^^ and bi — > bx'j' decays four selections have been optimised. 
These selections typically cover AM regions of: 5-10 GeV, 10-20 GeV, 20-40 GeV and > 40 
GeV. In case of ti — * hiu decays three selections are devised for each lepton flavour. These 
selections cover the AM = Mq — Mc region consistent with the limit Mp >43 GeV from 

LEPi mj. 

The following kinematic variables are used in the selections: Lower cuts on E^is, P™'^^ and 
P^^^^/E^is separate signal from two-photon background, whereas an upper cut on E^i^ removes 
W"'"W~, W^e^i/, ZZ and Ze"'"e~ events. A cut on sin6'miss rejects e"'"e~qq events. Cuts on jet 
acoUinearity and acoplanarity reduce the qq contribution. A veto on the energy deposition 
in the 50° azimuthal sector around the missing momentum direction suppresses t~^t~ and 
qq events. The W"'"W~ production, where one W decays leptonically and W'^e'^u events are 
removed by vetoing energetic isolated leptons. The cut on -Ettj suppresses e"'"e~qq, qq as well 
as W"'"W~ backgrounds. 

For the selections of bi —>■ bx? and ti — > hii) signal events, cuts are applied on the event 
b-tagging variable -Detag- 

At least one isolated lepton is required in the case of ti -^ hii) decays. An electron is isolated 
if the calorimetric energy deposition in a 10° cone around its direction is less than 2 GeV. Muon 
isolation requirement implies an energy deposition in the cone between 5° to 10° around its 
direction of less than 2 GeV. A tau is isolated when the calorimetric energy deposition in the 
cone between 10° to 20° around its direction is less than 2 GeV and less than 50% of the tau 
energy. Furthermore, the energy deposition in a cone between 20° to 30° must be less than 
60% of the tau energy. Finally, a lower cut on the energy of the most energetic lepton in the 
event is applied in order to suppress mainly the two-photon and the qq backgrounds. 

The cut values on the kinematic variables are chosen by an optimisation procedure for the 
different AM regions. The procedure minimises the average limit for an infinite number of 
trials assuming only background contributions [21J. For each signal mass point, the optimal 
selection or combination of selections is chosen. 

The expected signal efficiencies for a 90 GeV stop and sbottom at various AM values are 
given in Table Q together with the SM background expectations. 



5 Systematic Errors 

The errors arising from the signal MC statistics vary from 3% to 8% for the stop and from 3% 
to 7% for the sbottom depending on selection efficiencies. 

The main systematic errors on the signal selection efficiency arise from the uncertainties in 
the squark production, hadronisation and decay scheme. We have studied the following sources 
of systematic errors: 

• The squark signals are generated assuming cos6'lr=1. However, as their coupling to the 
Z depends on cos 6'lr, the initial state radiation spectrum is also mixing angle dependent. 
The maximal influence of this source has been evaluated by generating signal samples 
with the values of cos 6'lr when the squarks decouple from the Z. The largest decrease 
in the selection efficiencies, 4% for stop and 6% for sbottom, is observed at low AM ~ 
5-10 GeV. With increasing AM the selection efficiencies are less affected by this source 
of systematics. At AM ~ 70 GeV the error is estimated to be negligible. Conservatively, 
for the limit calculation we use the efficiencies obtained at decoupling values of cos^^lr- 

• The invariant mass available for spectator quarks has been assumed to be Meff=0.5 
GeV j22]. The hadronic energy and track multiplicity of the event depend on the value 
of this variable. A variation of Meg from 0.25 GeV to 0.75 GeV ^ results in 4 - 12% 
relative change in efficiency for stop and 6 — 8% for sbottom. 

• For the hadron containing a squark, the Peterson fragmentation scheme jSHl is used with 
the parameter e^ propagated from eb such that eq = ebm^/m? with eb = 0.0035 J21I and 
?Tib=5 GeV. The eb is varied in the range from 0.002 to 0.006 |21|. This induces 5 — 12% 
and 2 — 6% changes in the selection efficiencies for ti and bi, respectively. 

• For the ti —>■ ex? decays the uncertainty on the c-quark fragmentation parameter ec results 
in a 1 — 4% change in efficiency when ec is varied from 0.02 to 0.06 24j. The central value 
is chosen to be e^ = 0.03 



• For the stop three-body decay mode ti —>■ b£z>, the weak structure of the decay matrix 
element ^^ is taken into account. The related possible source of systematics has been 
evaluated by generating signal events with only a phase-space model. The selection 
efficiencies are slightly higher in this case. Therefore the efficiency values obtained with 
the matrix element are used. 

The overall relative systematic error on the selection efficiencies ranges from 7% to 16% 
and from 7% to 11% for stop and sbottom, respectively. This error and the uncertainty on the 
background normalisation, dominated by MC statistics, as well as the quoted uncertainty on 
two-photon background, are incorporated ^B] in the final results. 



6 Results 

Table 121 summarises the number of selected data and expected background events with different 
AM selections for all investigated channels. A total of 35 and 18 candidates appear in the 
ti —^ cXi and bi —>■ bx? selections, whereas 33.1 ± 4.3 and 13.5 ± 3.3 are expected from the 
SM processes. The numbers of ti —>■ hii) and ti -^ brz> candidates are 9 and 18, compared with 
11.3 ± 3.0 and 21.4 ± 4.4 expected events. 



The composition of the expected background into two-fermion, four-fermion and two-photon 
processes is given in Table El When all the AM selections for all investigated channels are 
applied, 59 events are retained. This is consistent with 60.4 ± 6.5 events expected from SM 
processes, mainly due to two-photon interactions. Thus no evidence for stop or sbottom is 
found and upper limits are derived on their production cross sections. 

Model-independent cross section limits in the Mq, M^o plane are given in Figure |2l for stop 
and sbottom assuming 100% branching fraction for the ti -^ cx° and bi -^ bxj decays. The 
limits are obtained by combining the present results with those obtained at ^/s = 161 — 172 
GeV and 183 GeV 0. The evaluated limits correspond to luminosity weighted average cross 
sections. In the medium AM region cross sections larger than 0.08 pb are excluded. 

The cross section limits for stop production assuming ti -^ hiu decay, in the two scenarios 
for lepton flavours, £=e, /i, r with equal probability or £=t, are given in FigureOl Cross sections 
larger than 0.05 pb are excluded if the mass difference AM = Mq — M;> is greater than 25 — 35 
GeV. 

7 MSSM Interpretation 

In the MSSM the stop and sbottom production cross sections depend on the squark mass and 
the mixing angle cos6'lr. Comparing the theoretical prediction with the 95% C.L. limit on 
the production cross section, we determine the excluded mass regions for ti and bi. Figure |3^ 
shows the excluded ti mass region as a function of M^^ and M^o at cos^lr=1 and 0.57 for 
the ti — > cXi decay. For this decay mode, stop masses below 88 GeV are excluded under the 
assumptions of AM=Mi_^ — M^o greater than 15 GeV and cos^lr=1- For the same values of 
AM and in the most pessimistic scenario of cos^lr=0.57, the mass limit is 81 GeV. The region 
where ti — *> bWx? decay is kinematically accessible and becoming the dominant decay mode, 
is also indicated. This decay is not considered in the analysis. 

The exclusion plot for the sbottom is given in Figure IHd for cos^lr=1 and cos^lr=0.39. 
Sbottom masses below 85 GeV are excluded assuming AM greater than 15 GeV and cos^lr=1- 
In the most pessimistic scenario of cos^lr=0.39, the mass limit obtained is 64 GeV. 

The excluded stop mass regions, if the dominant three-body decays are kinematically open, 
are given in Figure El Figure Ek corresponds to ti -^ b£z>, i=e, fi, r with equal probability. 
Here the lower ti mass limits are 89 GeV and 86 GeV for cos^lr=1 and 0.57, respectively. The 
corresponding exclusion limits for stop decays through ti -^ hru are shown in Figure Eb- Mass 
limits of 88 GeV and 83 GeV are obtained, assuming AM >15 GeV. 

For a fixed value of AM =15 GeV the excluded stop and sbottom masses as a function of 
the mixing angle are shown in Figure El The exclusion limits mainly reflect the cross section 
behaviour. At cos6'lr=1, the ti and bi cross sections are quite similar. As cos6'lr decreases 
squark production proceeds mainly via 7 exchange rendering the sbottom production cross 
section about 4 times lower than that of the stop. Consequently, the sbottom exclusion limits 
are relatively modest at low cos ^lr values. 

For squarks of the first two generations, the same selection efficiencies are assumed as for 
the stop two-body decays, because of the similar event topologies (jets and missing energy). 
Then the cross section limits given in Figure Et are interpreted in terms of degenerate squark 
masses. Figure [7^ shows the squark mass limit as a function of the LSP mass. Two scenarios 
are considered: "left" and "right" squark degeneracy or only "right" squark production. In 
the first case, with four degenerate squark fiavours, the mass limit is set at 91.5 GeV for AM 

6 



greater than 10 GeV. In the case of only "right" squark production, the mass hmit is 90 GeV. 
The regions excluded, if all squarks but the stop are degenerate are also shown. 

Assuming gaugino unification at the GUT scale, the results on the four degenerate squarks 
are reinterpreted on the Mg, M^ plane as shown in Figure[7|3. Moreover, the gaugino unification 
allows a transformation of the absolute limit on M2, obtained from the chargino, neutralino 
and scalar lepton searches [2j, into a limit on the gluino mass as shown in Figure Eb. This is 
done using the ISAJET program [2Zj. For tan/3 = 4, gluino masses up to about 210—250 GeV 
are excluded at 95% C.L. 
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Table 1: Selection efficiencies, e, and number of expected events from SM processes, A'^sm, for 
a 90 GeV stop and sbottom, as a function of AM (see text). 



AM (GeV) 


ti^ 


CX? 


ti^ 


hit) 


ti^ 


brz/ 


bi^ 


bx? 


e(%) 


A^SM 


e(%) 


NsM 


e(%) 


NsM 


e(%) 


iVsM 


2 


0.1 


17.7 


- 


- 


- 


- 


- 


- 


5 


17.5 


17.7 


- 


- 


- 


- 


0.06 


12.3 


7 


21.6 


21.8 


15.8 


10.7 


5.6 


12.3 


17.6 


12.3 


10 


19.1 


4.10 


39.5 


10.7 


14.0 


12.3 


14.5 


12.7 


20 


48.1 


7.80 


57.3 


2.30 


41.5 


8.50 


35.4 


0.46 


30 


62.7 


4.37 


45.3 


0.59 


35.2 


1.58 


42.8 


0.73 


40 


39.5 


4.37 


46.0 


0.59 


39.3 


1.58 


34.0 


1.19 


47 


47.0 


11.9 


37.1 


0.59 


35.2 


1.58 


29.7 


1.19 


60 


44.3 


11.9 


- 


- 


- 


- 


22.8 


0.52 


80 


38.4 


7.54 


- 


- 


- 


- 


23.0 


0.52 


88 


38.0 


7.54 


- 


- 


- 


- 


21.6 


0.52 
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Table 2: Number of observed events, Nd, and SM background expectations, A'^gM, for the stop 
and sbottom selections at very low (5-10 GeV), low (10-20 GeV), medium (20-40 GeV) and 
high (> 40 GeV) AM. The quoted errors are due to MC statistics only. 



Selection 


ti ^ ex? 


ti -^ Uu 


ti -^ hru 


bi ^ bx? 


iVo 


NsM 


iVo 


iVsM 


Nj, 


A^SM 


iVo 


A^SM 


Very low AM 
Low AM 

Medium AM 
High AM 


19 
3 

5 
8 


17.7 ±4.0 

4.1 ± 1.4 

4.37 ± 0.63 

7.54 ± 0.74 


7 
2 



8.4 ± 2.7 

2.3 ± 1.3 

0.59 ± 0.15 


14 

4 




12.3 ± 3.4 

8.5 ± 2.7 
1.58 ± 0.94 


16 

1 
2 


12.3 ± 3.3 
0.46 ± 0.22 
0.72 ± 0.26 
0.52 ± 0.14 


Combined 


35 


33.1 ± 4.3 


9 


11.3 ± 3.0 


18 


21.4 ± 4.4 


18 


13.5 ± 3.3 
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Table 3: Number of observed events, A^d, and SM background expectations, A'^sm, for the stop 
and sbottom selections. The contribution of two-fermion (qq, t~^t~), four-fermion (W"'"W~, 
W^e^z/, ZZ, Ze"'"e~) and two-photon (e^e~qq, e"'"e~r"'"r~) processes are given separately. The 
quoted errors are due to MC statistics only. 



Channel 


iVo 


-' 'two— fermion 


-' "four— fcrmion 


-' 'two— photon 


A^SM 


ti ^ ex? 


35 


0.41 ± 0.16 


13.6 ± 1.1 


19.1 ± 4.2 


33.1 ± 4.3 


ti -^ Uv 


9 


0.29 ± 0.15 


0.97 ± 0.24 


10.0 ± 3.0 


11.3 ±3.0 


ti -^ hri) 


18 


0.29 ± 0.15 


0.49 ± 0.19 


20.5 ± 4.4 


21.4 ± 4.4 


bi ^ bx? 


18 


0.17 ± 0.12 


1.45 ± 0.35 


11.8 ±3.3 


13.5 ± 3.3 


Total 


59 


0.84 ± 0.25 


14.5 ± 1.1 


45.1 ± 6.5 


60.4 ± 6.5 
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Figure 1: Distributions of a) -Evis, b) -Ettj (see text), c) the most energetic lepton energy 
Ee, and d) b-tagging event discriminant -Detag for data and MC events after preselection. 
Contributions from e"'"e~qq, qq and other backgrounds, dominated by W"^W~ production, are 
given separately. The distributions for expected signal events of t^ -^ c^J with Mi^=90 GeV, 
M^o=60 GeV (a,b), tR -^ hii> with Mi^=90 GeV, Mp=70 GeV (c) and Sr -^ bx? with Mi^=90 
GeV, M^o=60 GeV (d) are also shown. 
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Figure 2: Upper limits on a) e+e — *> titi — ^ cxicx? and b) e"'"e — >• bibi — *> bxibx? production 
cross section times branching ratio. Limits are obtained by combining the results at centre of 
mass energies of ^5=161-172 GeV, 183 GeV and 189 GeV. 
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Figure 3: Upper limits on a) e+e^ — * titi — > hC,^ vhCr i) , i = e, ^,t assuming lepton universality 
and b) e^e~ —>■ titi —>■ br"'"z/br~z> production cross section times branching ratio. Limits are 
obtained from the ^¥=189 GeV data. 
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Figure 4: 95% CL. exclusion limits in the MSSM on the masses of a) stop decaying via ti -^ q,X{ 
and b) sbottom decaying via bi -^ bx5 £^s a function of the neutralino mass with maximal and 
minimal cross section assumptions. For comparison results on stop searches obtained by CDF j7] 
and on sbottom searches obtained by DO ^ experiments are also shown. 
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Figure 5: 95% CL. exclusion limits in the MSSM on the mass of stop decaying via a) ti -^ hiu, 
i = e, ^,T with equal probability and b) ti — > brz/, as a function of the sneutrino mass with 
maximal and minimal cross section assumptions. The sneutrino mass limit obtained at LEPl 
is also shown. 
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Figure 6: 95% CL. exclusion limits in the MSSM as a function of the mixing angle cos^lr 
for the a) stop decaying via ti -^ ex? (solid hne) and sbottom decaying via bi -^ bx? (dashed 
line), b) stop decaying via ti -^ Mi), i = e, fi,T with equal probability (solid line) and ti -^ hru 
(dashed line). 
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Figure 7: a) 95% CL. exclusion limits in the MSSM on the masses of the degenerate squarks 
decaying via q — *> qx?- b) Excluded regions in the (Mg, Mq) plane. The dark shaded area is 
excluded from the search of squarks of the first two families, assuming the mass degeneracy 
among different flavours and between "left" - "right" squarks. The light shaded area illustrates 
indirect limits on the gluino mass, derived from the chargino, neutralino and scalar lepton 
searches. The regions excluded by the CDF and DO collaborations [,28j are valid for tan/3 = 4 
and /i = —400 GeV. The exclusions obtained by the UAl and UA2 (2Sij collaborations are also 
shown. 
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